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Fanout Upgrade for a Scalable Switching Network 



10 Background - Field of Invention 

This invention relates to redundant multistage switching networks, specifically to the non-stop 
q addition of new ports to all routers of each row of such a network. 

13|ff Background - Discussion of Prior Art 



CP Many multistage switching networks are defined primarily as binary based. Some of these 



2cN Kg. 1A shows an 8-port binary Banyan network. Banyan networks are an example of multistage 



ternary Banyan network. Both examples have the same number of rows. 

There is no known investigation of the process of upgrading the fanout of Banyan networks. 

25 There are two likely reasons why such an upgrade path is undesirable. First, most 
implementations of switching networks using the Banyan architecture employ specific binary 
sorting algorithms to route traflic. Second, an upgrade of an #-stage 2^-port binary network to 
an n-stage 2x3 w -port ternary network or /s-stage 2x4 K -port quaternary network would entail an 
exponential growth in number of ports required. From the examples already shown, this is a very 

30 large number even for the small numbers considered here. 




p| switching networks that have been generalized to arbitrary fanouts. Kg. IB shows a 27-port 



Objects and Advantages 

Accordingly, the several objects and advantages of my invention are: 

(a) to provide a procedure by which a redundant multistage switching network can be upgraded 
by expanding the number of ports per router without having to break an external connection; 
and 

(b) to provide a procedure by which a redundant multistage switching network can be upgraded 
by expanding the number of ports per router with a minimum loss in throughput bandwidth. 



Further objects and advantages of our invention will become apparent from a consideration of 
the drawings and ensuing description. 
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Description of Drawings 

Fig, 1A shows a 16 port binary Banyan multistage switching network with three rows, (prior art) 

5 Fig. IB shows a 54 port ternary Banyan multistage switching network with three rows, (prior art) 

Fig. 2 shows a 30 port redundant blocking compensated cyclic group (RBCCG) multistage 
switching network Hashed areas represent slots for adding ports (prior art) 

10 Fig. 3A shows a 30 port RBCCG multistage switching network where all routers have been 
augmented by 2 ports each, resulting in a 40 port switching network. 

t Fig. 3B shows a section of a 40-port RBCCG multistage switching network with the proper 
O interconnection network between two rows of routers. 

15 tJ' 

O Fig. 4A, Fig. 4B, Fig. 4Q Fig. 4D, Fig. 4E, Fig. 4F, Fig. 4G, Fig. 4H, Fig. 41, Fig. 4J, Fig. 4K, 
1 1 Fig. 4L, Fig. 4M, Fig. 4N, Fig. 40, and Fig. 4P show the connections between router rows 
R(l,*) and R(2,*) being rewired into a 40 port RBCCG multistage switching network 
HP interconnection by adding a connection between bottom port 3 of R(l,4) and top port 3 of R(2 ? 4); 

2<|4 adding a connection between bottom port 3 of R(l ? 3) and top port 3 of R(2,0); moving the 

Pi} 

St connection from top port 2 of R(2,4) to top port 3 of R(2,3); moving the connection from top port 
2 of R(2,3) to top port 3 of R(2,2); moving the connection from top port 2 of R(2,0) to top port 2 
of R(2,3); moving the connection from top port 2 of R(2,2) to top port 3 of R(2,l); moving the 
connection from top port 2 of R{2 ? 1) to top port 2 of R(2 ? 4); adding a connection between bottom 

25 port 3 of R(l ? 2) and top port 2 of R(2 ? l); moving the connection from top port 1 of R(2,4) to top 
port 2 of R(2,2); moving the connection from top port 1 of R(2 ? 2) to top port 1 of R(2 ? 4); adding 
a connection between top port 1 of R(2,2) and bottom port 3 of R(l,l); moving the connection 
from bottom port 0 of R(l ? l) to bottom port 3 of R(1,0); moving the connection from top port 1 
of R(2,3) to top port 2 of R(2,0); moving the connection from top port 1 of R(2,l) to top port 1 of 

30 R(2 ? 3); moving the connection from top port 1 of R(2 ? 0) to top port 1 of R(2,l); moving the 
connection from bottom port 1 of R(l ? l) to bottom port 0 of R(l,l), respectively. 
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Kg. 4Q shows a partially upgrade 40 port multistage switching network with a completed rewire 
of the interconnections between router rows R(l,*) and R(2,*) adding a connection between 
bottom port 1 of R(U) and top port 1 of R(2,0). 

5 Fig. 5B shows a partially upgrade 40 port multistage switching network with a completed rewire 
of the interconnections between router rows R(0,*) and R(l,*) 

Fig, 5C shows a partially upgrade 40 port multistage switching network with a completed rewire 
of the interconnections between router rows R(2,*) and R(3,*) 

10 

Fig. 6A, Fig. 6B, Fig. 6C, Fig. 6D, Fig. 6E, Fig. 6F, Fig. 6G, Fig. 6H, Fig. 61, Fig. 6J 9 Fig. 6K, 
Fig. 6L, Fig. 6M 9 Fig. 6N, Fig. 60, Fig. 6P, Fig. 6Q, Fig. 6R, Fig. 6S, Rg. 6T, Fig. 6U, Fig. 
J! 6Vand Rg. 6W show the connections between router rows R(l, *) and R(2, *) being rewired in 

y 

O an alternate method into a 40 port RBCCG multistage switching network interconnection by an 
I5|p alternate method. First, by swapping bottom ports 1 aiidO of R(l,l); swapping bottom ports 2 

Cj and 1 of R(l ? l); swapping bottom ports 0 and 3 of R(l,2); swapping bottom ports 2 and 0 of 

ft 

p R(l,2); swapping bottom ports 0 and 2 of R(l,3); swapping bottom ports 1 and 3 of R(l,3); 
^ swapping bottom ports 0 and 1 of R(l,4); swapping bottom ports 0 and 2 of R(l,4); swapping 
p bottom ports 0 and 3 of R(l,4); swapping top ports 2 and 3 of R(2 ? 4); swapping top ports 1 and 2 
20^ of R(2,4); swapping top ports 2 and 3 of R(2 ? 3); swapping top ports 2 and 3 of R(2,2); swapping 
top ports 1 and 2 of R(2 ? l); and finally, swapping top ports 2 and 3 of R(2,0) ? respectively. 
Second by adding a connection between bottom port 0 of R(l,4) and top port 3 of R(2,l); adding 
a connection between top port 2 of R(2,3) and bottom port 1 of R(l,3); adding a connection 
between bottom port 2 of R(l ? 2) and top port 2 of R(2 ? 0); moving the connection from top port 1 
25 of R(2,l) to top port 2 of R(2,2); moving the connection from top port 1 of R(2,2) to top port 1 of 
R(2,4); adding a connection between top port 1 of R(2,2) and bottom port 3 of R(l ? l); moving 
the connection from top port 0 of R(2,3) to top port 1 of R(2,l); adding a connection between top 
port 0 of R(2,3) and bottom port 3 of R(1,0) , respectively. 
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Fig. 7A, Kg. 7B and Kg. 7C show the algorithm for expanding the finout of the component 
routers of a compensated cyclic group multistage switching network, Kg. 7 A shows the most 
general algorithm, while Kg. 7B shows a more specific algorithm. 

5 Fig. 8A and Kg 8B show two different algorithms for selecting the order the interconnections 
should be rewired. 

Fig. 9A, Kg. 9B, and Kg. 9C show three different algorithms for selecting v&ich port to rewire 
during the rewiring phase. 

10 

Kg. 10 shows an algorithm for relabeling ports to improve the efficiency of the upgrade process. 



M- Kg. 11 shows the flowchart for the fanout upgrade algorithm shown in Kg. 7 A and Fig. 7C. 

%, \ 

15, ^ Fig. 12 shows the flowchart for the fanout upgrade algorithm shown in Fig. 7B and Fig. 7C. 

-is? 5 
Q 

HJ 

p Kg. 13A and Kg. 13B show the flowcharts for the row selection algorithms shown in Fig. SA 

JL and Kg. 8B respectively. 

20 jU F»g« 14A, Fig. 14B and Fig. 14C show the flowcharts for the port selection algorithms shown in 

O Fig. 9A, Fig. 9B and Fig. 9C, respectively. 

in 

Kg. 15 shows flowchart for the relabeling algorithm shown in Kg. 10. 



Summary 

A multistage switching network can be expanded by adding ports to existing switching elements 
without breaking any external connections. 

5 

If the switching elements are routers or have the ability to route traffic the expansion may be 
performed without severely disrupting its ability to route traffic, provided that the routers 
themselves have the capability of having ports added while still in operation. Any number of 
ports may be added in any position as long as there are is an equal number added to both top and 
10 bottom ports. In general, these ports must be reassigned logically so the position of the new ports 
is irrelevant. 

^ The fanout upgrade process has three constituent components. The first component is to install 
P new line cards to provide each router with new ports. 
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The second component has two types steps of which one is optional The first type is to select a 
port that is misconnected in reference to the desired topology and to rewire it to its appropriate 
counterpart. The second type is optional and is the permutation of ports on the same router which 
results in a correct port being connected to the correct router. If such a permutation can be 
performed logically, traffic need not be disrupted. These two types of steps are repeated in any 
order until the desired topology is achieved. Since the ordering of such steps can be arbitrary, 
more structure can be added by breaking this component into three sub-components. 



The first sub-component is the selection of the order in which each interconnection network is 
25 rewired into the desired topology. The order can be arbitrary, however, since the path 
redundancy is greatest in the middle of the network, the best order has been found to start with 
the middle row or the closest to the middle. The subsequent rows should be ordered with those 
closest to the middle first and those ferthest away from the middle last. 
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The second sub-component, which is optional, is the permutation of ports described above. This 
step should always be taken before rewiring an interconnection network, if such a permutation 



can be performed logically so that no traffic disruption occurs. This step minimizes bandwidth 
reduction during the rewiring of an interconnection network 

The third sub-component is the rewiring phase. This is accomplished by systematically 
disconnecting from a selected port any misconnected connection to that port and to the 
corresponding port to which the selected port is to be connected. With any misconnections 
disconnected, the selected port and its appropriate corresponding port may then be connected. In 
order to minimize the impact on the throughput bandwidth, priority in the port selection process 
should be given to selecting ports not currently connected. This introduces a plethora of port 
selection algorithms. Additional preferences, contribute to better throughput bandwidth during 
the upgrade process. 

The final component is relatively simple. All external connections that are not already 
connection should be connected and placed into service. 
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Description of Invention 

A redundant blocking con^ensated cyclic group (RBCCG) multistage network, is shown in Big. 
2 and discussed further in United States Patent 5,841,775, "Scalable Switching Networks" by 
5 Alan Huang, Nov. 24, 1998. It consists of rows of routers or other switching elements. These 
rows of routers are connected together via interconnection networks. The routers are designated 
R(row, column) where the top left most router is denoted R(0,0). The top ports of each router 
are numbered from left to right starting with 0. The bottom ports of each router are numbered 
from left to right starting with 0. The top ports of each interconnection network are numbered 
10 from left to right starting with 0. The bottom ports of each interconnection network are numbered 
from left to right starting with 0. 

N This method applies routers or switching elements for which ports may added without having to 

q shutdown the router. In Fig. 2, the hatched areas on each router indicate potential insertion points 

15N. for new ports. Typically, routers are expanded by the addition of new line cards. Insertion of a 

Q new line card may add more than a single port. In general, many ports can be added using the 

p methods described here. In addition, a single line card with two or more ports may be installed to 

^ provide both additional top and bottom ports to a router. For the purposes here, the method is 

f; applied to the expansion of a single top port and a single bottom port for each router, as shown in 

20L Fig. 3A. With the new ports added, interconnection networks 10, 11, and 12 need to be rewired 

O to look like interconnection network 20 as shown in Fig. 3B. 

The most general form of the upgrade process is given by Fig. 7A, with supporting functions 
given in Fig. 7C, and flowcharted in Fig. 11. The first major step is to add the desired new ports 
25 to each routers. This is depicted in Fig. 7A and Fig. 11 with a algorithmic loop. Though no 
specific order is given for which the routers are augmented, they may be augmented in any order. 
No particular order has any advantage in terms of minimizing traffic disruption or number of 
steps. The choice may come down to which is physically more convenient. 

30 The upgrade process continues after the ports are added by selecting any port which is 
misconnected with respect to the desired final topology. The order of selection does have an 
impact on the disruption of traffic and even the number of total steps. A more systematic and 
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organized approach is given below in a refinement of this algorithm. Once a port is selected it is 
rewired by connecting it to its appropriate port with respect to the final topology. Henceforth, 
this port will be known as its corresponding port. The remainder of the algorithm in Big. 7A and 
flowchart Fig. 11 is a detailed description of the rewiring based on the connection states of the 
5 port and its corresponding port. 

There is also an optional branch in the upgrade process. In scanning the routers, one may 
discover routers for which some connections originate from the correct routers (with respect to 
the desired final topology) but connect to the wrong port. If a logical reassignment of port 
10 addresses were possible, achieving a virtual port permutation while leaving the physical 
connections unchanged. This would reduce the number of connections that need to be broken. 
This step, as indicated by the optional branch, may be executed at any time, that is it need not be 
JJ executed in every loop of the algorithm. For instance, the sequence could be rewire, relabel, 
O relabel, relabel, rewire, rewire, relabel, rewire, etc. A more systematic approach is given in a 
15jJ~ refined version of the upgrade algorithm. 
£3 

m The final step in this process is to connect and activate any new external ports that result from 
% v the addition of new ports in this upgrade process. 

2cjyu The upgrade process is refined in Fig. 7B with flowchart in Fig. 12. The first part with depicting 
jjjj the port addition and the last step involving the activation of new external ports are the same as 
the more general algorithm. The distinction is that the rewiring and the optional relabeling is 
made more systematic. The first refinement is that the process takes place row by row or more 
precisely interconnection network by interconnection network. This is illustrated by the creation 

25 of the "rowjselect" component. Once a row is selected the optional c<i relabeljports" component 
my be executed for that row. After that, a port that is part of the selected interconnection 
network, by convention the interconnection network below the selected row, is selected by the 
"select _port" component and rewired to its corresponding port. These three component 
algorithms are given in more detail below. 

30 

In the examples given below, the process of "diverting traffic" away from a port and "stop 
diverting traffic" from a port (also called "allow traffic to flow" to a port as stated in Fig, 9C.) 
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should occur automatically whenever a connection is broken (disconnected) and when a 
connection is established, respectively if the routers are running standard routing protocols such 
as OSPF. However, the disconnection process may be streamlined by forcing new routing table 
information to be the routers prior to the connection being broken, thereby speeding the upgrade 
5 process and minimisin g the impact on traffic. Likewise, a forced change to the routing table may 
expedite the mil use of bandwidth after a new connection is established. In addition, to 
streamline the notation in the flowcharts, Fig. 14 and Fig. 15, the act of disconnection also 
implies the diversion of traffic from its attached ports prior to the breaking of the connection, 
Also, the act of connecting two ports implies the allowing of new traffic flow through the two 
10 ports (or equivalently the "stopping of the diversion of traffic" from the two ports) after the 
attachment of a connection between the two ports. 

f* The "row_select" algorithms selects a sequencing of the interconnections between rows. Each 
P interconnection shall be called by the row number, whose bottom ports the interconnections are 
ifj attached to. This sequence must include all the interconnections, but may be in any order. Fig. 

yi 

P 8A shows the best "row_select" algorithm Fig. 8B shows another common "rowjselect" 
g algorithm Fig. 13A and Fig. 13Bshowthe respective flowcharts. 

8 

J5 There is an optional relabel_ports stage, which will be described later. The remaining con^onent 
2C C of the ""Pgrade" algorithm is the "selectj>ort" port algorithm During the rewiring of each 
O interconnection network, the basic "upgrade" algorithm calls for the selection of any port, top or 
bottom not properly connected to it's appropriate corresponding port in accordance with 20 of 
Fig. 3B Though any port may be selected at each step, it has been found that priority should be 
given to ports that are not already connected. If a port that is already connected is selected, it 
25 may introduce an additional disconnection resulting in degradation of throughput bandwidth. 
Kg. 9A, Kg. 9B and Kg. 9C show three common "select_port" algorithms. Corresponding 
flowcharts are shown in Kg. 14A, Fig. 14B, and Kg. 14C. 

Though there are many possible combinations of upgrading, even based on the two 'Vowjselect" 
30 algorithms, and three "selectjport" algorithms already described here. The best combination is 
described in detail, employing the algorithm in Fig. 8A for the row selection and the algorithm in 
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Kg. 9A for port selection. Since all three interconnections, 10, 11, and 12 of Fig. 3A 
identical, the rewiring is shown only in detail for the first iteration of rewiring. 



are 



The process begins by selecting bottom port 3 of R(l,4) because scanning from right to left, it is 
the first port bottom or top not connected to anything and whose corresponding port (according 
to Fig. 3B) is also not connected to anything; establishing a new connection between bottom port 
3 of R(l,4) and top port 3 of R(2,4) as shown in Fig. 4A; starting bottom port 3 of R(l,4) and top 
port 3 of R(2,4); and stop diverting the traffic from bottom port 3 of R(l,4) and top port 3 of 
R(2,4). 
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The process continues by selecting bottom port 3 of R(l,3) because scanning from right to left, it 
is the first port bottom or top not connected to anything and whose corresponding port 
|4 (according to Fig. 3B) is also not connected to anything; establishing a new connection between 
0 bottom port 3 of R(l,3) and top port 3 of R(2,0) as shown in Fig. 4B; starting bottom port 3 of 
1%4 R(l,3) and top port 3 of R(2,0); and stop diverting the traffic from bottom port 3 of R(l,3) and 
|j topport3ofR(2,0). 



Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
I connected. Again, scanning from right to left, top port 3 of R(2,3) is not connected to anything 
20H with corresponding port according to Fig. 3B, bottom port 2 of R(l,4). Bottom port 2 of R(l,4) is 
Q currently connected to top port 2 of R(2,4). The breaking of this connection does not leave router 
? * R(l,4) or router R(2,4) with more than one broken connection. This completes the selection 
process for this step. 

25 With top port 3 of R(2,3) selected and recalling that its corresponding port, bottom port 2 of 
R(l,4), is connected to top port 2 of R(2,4), the process continues by diverting traffic from 
bottom port 2 of R(l,4) and top port 2 of R(2,4); stopping bottom port 2 of R(l,4) and top port 2 
of R(2,4); disconnecting bottom port 2 of R(l,4) and top port 2 of R(2,4) and moving the 
disconnected connection to top port 3 of R(2,3) as shown in Fig. 4C; starting top port 3 of R(2,3) 

30 and bottom port 2 of R(l,4); and stop diverting the traffic from top port 3 of R(2,3) and bottom 
port 2 of R(l,4). 
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Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
connected Again, scanning from right to left, top port 2 of R(2,4) is not connected to anything 
with corresponding port according to Fig. 3B, bottom port 2 of R(l,3). Bottom port 2 of R(l,3) is 
currently connected to top port 2 of R(2,l). The breaking this connection introduces a second 

5 broken connection to R(2,l), so top port 2 of R(2,4) is not selected. Continuing to scan from 
right to left, bottom port 3 of R(l 5 2) is not connected to anything with corresponding port 
according to Kg, 3B, top port 2 of R(2,l). Top port 2 of R(2,l) is currently connected to bottom 
port 2 of R(l,3). The breaking this connection introduces a second broken connection to R(2,l), 
so bottom port 3 of R(l,2) is not selected. Continuing to scan from right to left, top port 3 of 
10 R(2,2) is not connected to anything with corresponding port according to Kg. 3B, bottom port 1 
of R(l,4). Bottom port 1 of R(l,4) is currently connected to top port 2 of R(2,3). The breaking of 
this connection does not leave router R(l,4) or router R(2,3) with more than one broken 

{* connection. This completes the selection process for this step. 

ldSl With top port 3 of R(2,2) selected and recalling that its corresponding port, bottom port 1 of 

m 

O R(l,4), is connected to top port 2 of R(2,3), the process continues by diverting traffic from 
|2 bottom port 1 of R(l,4) and top port 2 of R(2,3); stopping bottom port 1 of R(l,4) and top port 2 
of R(2,3); disconnecting bottom port 1 of R(l,4) and top port 2 of R(2,3) and moving the 
jg disconnected connection to top port 3 of R(2,2) as shown in Fig. 4D; starting top port 3 of R(2,2) 
2<ft and bottom port 1 of R(l,4); and stop diverting the traffic from top port 3 of R(2,2) and bottom 
O port 1 of R(l,4). 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
connected. Again, scanning from right to left, top port 2 of R(2,4) is not connected to anything 

25 with corresponding port according to Kg. 3B, bottom port 2 of R{1,3). Bottom port 2 of R(l,3) is 
currently connected to top port 2 of R(2,l). The breaking this connection introduces a second 
broken connection to R(2,l), so top port 2 of R(2,4) is not selected. Continuing to scan from 
right to left, top port 2 of R(2,3) is not connected to anything with corresponding port according 
to Fig. 3B, bottom port 1 of R(l,3). Bottom port 1 of R(l,3) is currently connected to top port 2 

30 of R(2,0). The breaking of this connection does not leave router R(l,3) or router R(2,Q) with 
more than one broken connection. This completes the selection process for this step. 
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With top port 2 of R(2,3) selected and recalling that its corresponding port, bottom port 1 of 
R(l,3), is connected to top port 2 of R(2,0), the process continues by diverting traffic from 
bottom port 1 of R(l,3) and top port 2 of R(2,0); stopping bottom port 1 of R(l,3) and top port 2 
of R(2,0); disconnecting bottom port 1 of R(l,3) and top port 2 of R(2,0) and moving the 
5 disconnected connection to top port 2 of R(2,3) as shown in Fig. 4E; starting top port 2 of R(2,3) 
and bottomport 1 of R(l,3); and stop diverting the traffic from top port 2 of R(2,3) and bottom 
port 1 of R(l,3). 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
10 connected. Again, scanning from right to left, top port 2 of R(2,4) is not connected to anything 
with corresponding port according to Fig. 3B, bottom port 2 of R(l,3). Bottom port 2 of R(l,3) is 
currently connected to top port 2 of R(2,l). The breaking this connection introduces a second 
H broken connection to R(2,l), so top port 2 of R(2,4) is not selected. Continuing to scan from 
g right to left, bottom port 3 of R(l,2) is not connected to anything with corresponding port 
lH according to Fig. 3B, top port 2 of R(2,l). Top port 2 of R(2,l) is currently connected to bottom 
Q P ort 2 of R(l,3). The breaking this connection introduces a second broken connection to R(2,l), 
§ s 0 bottom port 3 of R(l,2) is not selected. Continuing to scan from right to left, bottom port 3 of 
^ R (1 5 1) is not connected to anything with corresponding port according to Fig. 3B, top port 1 of 
M R( 2 r2)- Top port 1 of R(2,2) is currently connected to bottom port 1 of R(l,2). The breaking this 
2 C connection introduces a second broken connection to R(l,2), so bottom port 3 of R(l,l) is not 
P selected. Continuing to scan from right to left, top port 3 of R(2,l) is not connected to anything 
with corresponding port according to Fig. 3B, bottom port 0 of R(l,4). Bottom port 0 of R(l,4) is 
currently connected to top port 2 of R(2,2). The breaking of this connection does not leave router 
R(l,4) or router R(2,2) with more than one broken connection. This completes the selection 
25 process for this step. 

With top port 3 of R(2,l) selected and recalling that its corresponding port, bottom port 0 of 
R(l,4), is connected to top port 2 of R(2,2), the process continues by diverting traffic from 
bottom port 0 of R(l,4) and top port 2 of R(2,2); stopping bottom port 0 of R(l,4) and top port 2 
30 of R(2,2); disconnecting bottom port 0 of R(l,4) and top port 2 of R(2,2) and moving the 
disconnected connection to top port 3 of R(2,l) as shown in Fig. 4F; starting top port 3 of R(2,l) 
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and bottom port 0 of R(l,4); and stop diverting the traffic from top port 3 of R(2,l) and bottom 
port 0 of R(l,4). 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
5 connected. Again, scanning from right to left, top port 2 of R(2,4) is not connected to anything 
with corresponding port according to Kg. 3B, bottom port 2 of R(l,3). Bottom port 2 of R(l,3) is 
currently connected to top port 2 of R(2,l). The breaking of this connection does not leave router 
R(l,3) or router R(2,l) with more than one broken connection. This completes the selection 
process for this step. 

10 

With top port 2 of R(2,4) selected and recalling that its corresponding port, bottom port 2 of 
R(l,3), is connected to top port 2 of R(2,l), the process continues by diverting traffic from 
bottomport 2 of R(l,3) and top port 2 of R(2,l); stopping bottom port 2 of R(l,3) and top port 2 

Jj? of R(2,l); disconnecting bottom port 2 of R(l,3) and top port 2 of R(2,l) and moving the 
1$4 disconnected connection to top port 2 of R(2,4) as shown in Kg. 4G; starting top port 2 of R(2,4) 

Q and bottom port 2 of R(l,3); and stop diverting the traffic from top port 2 of R(2,4) and bottom 

jj port 2 of R(l,3). 

Si 

D 

T| The process continues by selecting bottom port 3 of R(l,2) because scanning from right to left, it 
2<fr* is the first port bottom or top not connected to anything and whose corresponding port 
O (according to Kg. 3B) is also not connected to anything; establishing a new connection between 
m bottom port 3 of R(l,2) and top port 2 of R(2,l) as shown in Kg. 4H; starting bottom port 3 of 

R(l,2) and top port 2 of R(2,l); and stop diverting the traffic from bottom port 3 of R(l,2) and 

topport2ofR(2,l). 

25 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
connected. Again, scanning from right to left, top port 2 of R(2,2) is not connected to anything 
with corresponding port according to Kg. 3B, bottomport 0 of R(l,3). Bottomport 0 of R(l,3) is 
currently connected to top port 1 of R(2,4). The breaking of this connection does not leave router 
3D R(l 9 3) or router R(2,4) with more than one broken connection. This completes the selection 
process for this step. 
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With top port 2 of R(2,2) selected and recalling that its corresponding port, bottom port 0 of 
R(l,3), is connected to top port 1 of R(2,4), the process continues by diverting traffic from 
bottom port 0 of R(l,3) and top port 1 of R(2,4); stopping bottom port 0 of R(l,3) and top port 1 
of R(2,4); disconnecting bottom port 0 of R(l,3) and top port 1 of R(2,4) and moving the 
5 disconnected connection to top port 2 of R(2,2) as shown in fig. 41; starting top port 2 of R(2,2) 
and bottom port 0 of R(l,3); and stop diverting the traffic from top port 2 of R(2,2) and bottom 
port 0 of R(l,3). 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
10 connected. Again, scanning from right to left, top port 1 of R(2,4) is not connected to anything 
with corresponding port according to Mg. 3B, bottom port 1 of R(l,2). Bottom port 1 of R(l,2) is 
currently connected to top port 1 of R(2,2). The breaking of this connection does not leave router 

jj-jj R(l,2) or router R(2,2) with more than one broken connection. This completes the selection 

j| process for this step. 

IP 

g With top port 1 of R(2,4) selected and recalling that its corresponding port, bottom port 1 of 
U R(l,2), is connected to top port 1 of R(2,2), the process continues by diverting traffic from 

r bottom port 1 of R(l,2) and top port 1 of R(2,2); stopping bottom port 1 of R(l,2) and top port 1 

Q 

IP of R(2,2); disconnecting bottom port 1 of R(l,2) and top port 1 of R(2,2) and moving the 
2cH* disconnected connection to top port 1 of R(2,4) as shown in Fig. 4J; starting top port 1 of R(2,4) 
Q and bottom port 1 of R(l,2); and stop diverting the traffic from top port 1 of R(2,4) and bottom 
ni port 1 of R(l,2). 

The process continues by selecting top port 1 of R(2,2) because scanning from right to left, it is 
25 the first port bottom or top not connected to anything and whose corresponding port (according 
to Fig. 3B) is also not connected to anything; establishing a new connection between top port 1 
of R(2,2) and bottom port 3 of R(l,l) as shown in Fig. 4K; starting top port 1 of R(2,2) and 
bottom port 3 of R(l,l); and stop diverting the traffic from top port 1 of R(2,2) and bottom port 3 
ofR(l,l). 

30 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
connected Again, scanning from right to left, bottom port 3 of R(1,0) is not connected to 
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anything with corresponding port according to Kg. 3B, top port 0 of R(2,3). Top port 0 of R(2,3) 
is currently connected to bottom port 0 of R(l,l). The breaking of this connection does not leave 
router R(l,l) or router R(2,3) with more than one broken connection. This completes the 
selection process for this step. 

5 

With bottom port 3 of R(1,0) selected and recalling that its corresponding port, top port 0 of 
R(2,3), is connected to bottom port 0 of R(l,l), the process continues by diverting traffic from 
top port 0 of 11(2,3) and bottom port 0 of R(l,l); stopping top port 0 of R(2,3) and bottom port 0 
of R(l,l); disconnecting top port 0 of R(2,3) and bottom port 0 of R(l ? l) and moving the 
10 disconnected connection to bottom port 3 of R(1,0) as shown in Kg. 4L; starting bottom port 3 
of R(1,0) and top port 0 of R(2,3); and stop diverting the traffic from bottom port 3 of R(1,0) and 
topport0ofR(2,3). 

% Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
lH connected. Again, scanning from right to left, bottom port 0 of R(l,l) is not connected to 

IF 

gj anything with corresponding port according to fig. 3B, top port 0 of R(2,4). Top port 0 of R(2,4) 

2 is currently connected to bottom port 1 of R(l,l). The breaking this connection introduces a 

a second broken connection to R(l,l), so bottom port 0 of R(l,l) is not selected. Continuing to 

2 scan from right to left, top port 2 of R(2,0) is not connected to anything with corresponding port 

2<jH according to fig. 3B, bottom port 2 of R(l,2). Bottom port 2 of R(l,2) is currently connected to 

0 top port 1 of R(2,3). The breaking of this connection does not leave router R(l,2) or router 

'Hi 

1 v R(2,3) with more than one broken connection. This completes the selection process for this step. 

With top port 2 of R(2,0) selected and recalling that its corresponding port, bottom port 2 of 
25 R(l>2), is connected to top port 1 of R(2,3), the process continues by diverting traffic from 
bottom port 2 of R(l,2) and top port 1 of R(2,3); stopping bottom port 2 of R(l,2) and top port 1 
of R(2,3); disconnecting bottom port 2 of R(l,2) and top port 1 of R(2,3) and moving the 
disconnected connection to top port 2 of R(2,0) as shown in fig. 4M; starting top port 2 of 
R(2,0) and bottom port 2 of R(l,2); and stop diverting the traffic from top port 2 of R(2,0) and 
30 bottom port 2 of R(l,2). 
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Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
connected. Again, scanning from right to left, top port 1 of R(2,3) is not connected to anything 
with corresponding port according to Fig. 3B ? bottom port 0 of R(l,2). Bottom port 0 of R(l,2) is 
currently connected to top port 1 of R(2,l). The breaking of this connection does not leave router 
5 R(l,2) or router R(2,l) with more than one broken connection. This completes the selection 
process for this step. 

With top port 1 of R(2,3) selected and recalling that its corresponding port, bottom port 0 of 
R(l,2), is connected to top port 1 of R(2,l), the process continues by diverting traffic from 
10 bottom port 0 of R(l,2) and top port 1 of R(2,l); stopping bottom port 0 of R(l,2) and top port 1 
of R(2,l); disconnecting bottom port 0 of R(i,2) and top port 1 of R(2,l) and moving the 
disconnected connection to top port 1 of R(2,3) as shown in Fig. 4N; starting top port 1 of R(2,3) 
ju and bottom port 0 of R(l,2); and stop diverting the traffic from top port 1 of R(2,3) and bottom 
Jj port0ofR(l,2). 
lH 

in 

q Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
•jjjjjjj connected. Again, scanning from right to left, top port 1 of R(2,l) is not connected to anything 
at with corresponding port according to Fig. 3B, bottom port 2 of R(l,l). Bottom port 2 of R(l,l) is 
J currently connected to top port 1 of R(2,0). The breaking this connection introduces a second 
2<ff broken connection to R(l,l), so top port 1 of R(2,l) is not selected. Continuing to scan from 
O right to left, bottom port 0 of R(l,l) is not connected to anything with corresponding port 
* ^ according to Fig. 3B, top port 0 of R(2,4). Top port 0 of R(2,4) is currently connected to bottom 
port 1 of R(l,l). The breaking this connection introduces a second broken connection to R(l,l), 
so bottom port 0 of R(l,l) is not selected. Since none of the ports that are not connected satisfy 
25 the second port selection criterion, the selection process continues by selecting the rightmost port 
not connected to anything, that is top port 1 of R(2,l). 

With top port 1 of R(2,l) selected and recalling that its corresponding port, bottom port 2 of 
R(l,l), is connected to top port 1 of R(2,0), the process continues by diverting traffic from 
30 bottom port 2 of R(l,l) and top port 1 of R(2,0); stopping bottom port 2 of R(l,l) and top port 1 
of R(2,0); disconnecting bottom port 2 of R(l,l) and top port 1 of R(2,0) and moving the 
disconnected connection to top port 1 of R(2,l) as shown in Fig. 40; starting top port 1 of R(2,l) 



18 



and bottom port 2 of R(l,l); and stop diverting the traffic from top port 1 of R(2,l) and bottom 
port2ofR(l,l). 

Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
5 connected. Again, scanning from right to left, bottom port 0 of R(l,l) is not connected to 
anything with corresponding port according to Fig. 3B, top port 0 of R(2,4). Top port 0 of R(2,4) 
is currently connected to bottom port 1 of R(l,l). The breaking this connection introduces a 
second broken connection to R(1,1X so bottom port 0 of R(l,l) is not selected. Continuing to 
scan from right to left, top port 1 of R(2,0) is not connected to anything with corresponding port 
10 according to Fig. 3B, bottom port 1 of R(l,l). Bottom port 1 of R(l,l) is currently connected to 
top port 0 of R(2,4). The breaking this connection introduces a second broken connection to 
R(l,l), so top port 1 of R(2,0) is not selected. Since none of the ports that are not connected 
§J satisfy the second port selection criterion, the selection process continues by selecting the 
g rightmost port not connected to anything, that is bottom port 0 of R(l,l). 

■ft 

Mi 

g With bottom port 0 of R(l,l) selected and recalling that its corresponding port, top port 0 of 
J R(2,4), is connected to bottom port 1 of R(l,l), the process continues by diverting traffic from 
L to P P° rt 0 of R(2,4) and bottom port 1 of R(l,l); stopping top port 0 of R(2,4) and bottom port 1 
£ of R(l,l); disconnecting top port 0 of R(2,4) and bottom port 1 of R(l,l) and moving the 
2<T disconnected connection to bottom port 0 of R(l,l) as shown in Fig. 4P; starting bottom port 0 
Q of R(l,l) and top port 0 of R(2,4); and stop diverting the traffic from bottom port 0 of R(l,l) and 
•'*< topport0ofR(2,4). 

The process continues by selecting bottom port 1 of R(l,l) because scanning from right to left, it 
25 is the first port bottom or top not connected to anything and whose corresponding port 
(according to Fig. 3B) is also not connected to anything; establishing a new connection between 
bottom port 1 of R(l,l) and top port 1 of R(2,0) as shown in Fig. 4Q; starting bottom port 1 of 
8(1,1) and top port 1 of R(2,0); and stop diverting the traffic from bottom port 1 of R(l,l) and 
top port 1 of R(2,0). This completes the rewiring of interconnection network 11, between row 1 
30 and row 2. 
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According to the "row select" algorithm shown in Fig. 9A, interconnection network 10 should be 
rewired next. This is done by applying detailed rewiring just illustrated for interconnection 
network 1 1 to interconnection network 10. The results are shown in Fig. 5A. 

5 Continuing, according to the "tow select" algorithm shown in Fig. 9A interconnection network 
12 should be rewired next. This is done by applying detailed rewiring just illustrated for 
interconnection network 1 1 to interconnection network 12. The results are shown in Fig. 5B. 

This completes rewiring phase. All that is needed to complete the fanout upgrade of the network 
10 shown in Fig. 3A is to connect and activate the external ports 13 and 14. 

In a more sophisticated system, connections to ports on the same routers may be exchanged 

f* logically rather than physically. An example of such a swap is illustrated when interconnection 

O 

jjjjjj. network 11 of Fig. 3A is transformed into the interconnection network shown in Fig. 6 A by 
lfjj swapping bottom port 0 and bottom port 1 of router R(l,l). This may be accomplished logically 
Q by permanently diverting the traffic intended for bottom port 0 of router R(l,l) to bottom port 1 
J of router R(l,l) and the traffic intended for bottom port 1 of router R(l,l) to bottom port 0 of 
L, router R(l,l). Even if such a logical exchange is not possible the ports may be in such physical 
=C proximity to each other that a physical swap can be made while minimizing the time which the 
2< f disconnections occur resulting in very little impact on throughput bandwidth, m addition, only 
g port exchanges are used here, but natural extensions to general port permutations may also be 
employed. 

Again, rather than show a complete upgrade employing the relabel for the entire network. The 
25 upgrade and rewiring of interconnection network 11 of Fig. 3A (which is the same as 
interconnection networks 10, and 12 of Fig. 3A.) is shown in great detail here. The detail 
algorithm is given in Fig. 10 and flow chart Fig. 15. Though the relabeling algorithm shown here 
starts by scanning bottom ports and scanning them from left to right. Neither is necessary, top 
ports can be considered first and the order of scanning just needs to be systematic, a linear scan 
30 is the simplest. 
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The process begins by scanning bottom ports from left to right, R(l,l) is connected to R(2,4), but 
according to fig. 3B, bottom port 0 should be connected to R(2,4) instead of bottom port 1. The 
connection to those ports are swapped as shown in Fig. 6A. 

5 The process continues by scanning bottom ports from left to right, R(l,l) is connected to R(2,0), 
but according to Kg. 3B, bottom port 1 should be connected to R(2,0) instead of bottom port 2. 
The connection to those ports are swapped as shown in Kg. 6B. 

The process continues by scanning bottom ports from left to right, R(l,2) is connected to R(2,l), 
10 but according to Kg. 3B, bottom port 3 should be connected to R(2,l) instead of bottom port 0. 
The connection to those ports are swapped as shown in Kg. 6C. 

J* The process continues by scanning bottom ports from left to right, R(l,2) is connected to R(2,3), 
g but according to Kg. 3B, bottom port 0 should be connected to R(2,3) instead of bottom port 2. 
l|| The connection to those ports are swapped as shown in Kg. 6D. 

AO „ 

p The process continues by scanning bottom ports from left to right, R(l,3) is connected to R(2,4), 
^ but according to Kg. 3B, bottom port 2 should be connected to R(2,4) instead of bottom port 0. 
=p The connection to those ports are swapped as shown in Fig. 6E. 

O The process continues by scanning bottom ports from left to right, R( 1,3) is connected to R(2,0), 
but according to Kg. 3B, bottom port 3 should be connected to R(2,0) instead of bottom port 1. 
The connection to those ports are swapped as shown in Kg. 6F. 

25 The process continues by scanning bottom ports from left to right, R(l,4) is connected to R(2,2), 
but according to Kg. 3B, bottom port 1 should be connected to R(2,2) instead of bottom port 0. 
The connection to those ports are swapped as shown in Kg. 6G. 

The process continues by scanning bottom ports from left to right, R(l,4) is connected to R(2,3), 
30 but according to Kg. 3B, bottom port 2 should be connected to R(2,3) instead of bottom port 0. 
The connection to those ports are swapped as shown in Kg. 6H. 
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The process continues by scanning bottom ports from left to right, R(l,4) is connected to R(2,4), 
but according to Fig, 3B, bottom port 3 should be connected to R(2,4) instead of bottom port 0. 
The connection to those ports are swapped as shown in Kg. 61 



5 Scanning from left to right all bottom ports that should be swapped are swapped. In this example, 
the next step occurs by scanning top ports now from right to left. The direction is not important, 
but is reversed here purely for aesthetic value. In fact, any systematic scan will work. Unlike the 
scanning of bottom ports, the top ports should be connected to the correct bottom port, not just 
the correct router. 

10 

The process continues by scanning top ports from right to left, R(2,4) is connected to bottom port 
3 of R(l,4), but according to Fig. 3B, top port 3 should be connected to bottom port 3 of R(l,4) 
instead of top port 2. The connection to those ports are swapped as shown in Fig. 6J. 

o 

IS The process continues by scanning top ports from right to left, R(2,4) is connected to bottom port 
O 2 of R(l,3), but according to Fig. 3B, top port 2 should be connected to bottom port 2 of R(l,3) 
fj\ instead of top port 1. The connection to those ports are swapped as shown in Fig. 6K. 

*P The process continues by scanning top ports from right to left, R(2,3) is connected to bottom port 
2Cy, 2 of R(l,4), but according to Fig. 3B, top port 3 should be connected to bottom port 2 of R(l,4) 
y instead of top port 2. The connection to those ports are swapped as shown in Fig. 6L. 

The process continues by scanning top ports from right to left, R(2,2) is connected to bottom port 
1 of R(l,4), but according to Fig. 3B, top port 3 should be connected to bottom port 1 of R(l,4) 
25 instead of top port 2, The connection to those ports are swapped as shown in Fig. 6M. 

The process continues by scanning top ports from right to left, R(2,l) is connected to bottom port 
3 of R(l,2), but according to Fig. 3B, top port 2 should be connected to bottom port 3 of R(l,2) 
instead of top port 1. The connection to those ports are swapped as shown in Fig. 6N. 

30 
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The process continues by scanning top ports from right to left, R(2,0) is connected to bottom port 
3 of R(l,3), but according to Kg. 3B, top port 3 should be connected to bottom port 3 of R(l,3) 
instead of top port 2. The connection to those ports are swapped as shown in Fig* 60. 

5 This completes the scanning of the top ports, and the relabeling process. The process continues 
by employing the same "select jport" algorithm as in Fig. 9A as before. 

The process continues by selecting bottom port 0 of R(l,4) because scanning from right to left, it 
is the first port bottom or top not connected to anything and whose corresponding port 
10 (according to Fig. 3B) is also not connected to anything; establishing a new connection between 
bottom port 0 of R(l,4) and top port 3 of R(2,l) as shown in Fig. 6P; starting bottom port 0 of 
R(l,4) and top port 3 of R(2,l); and stop diverting the traffic from bottom port 0 of R(l,4) and 
| topport3ofR(2,l). 

si 

lftj The process continues by selecting top port 2 of R(2,3) because scanning from right to left, it is 
O the first port bottom or top not connected to anything and whose corresponding port (according 

■ so 

to Fig. 3B) is also not connected to anything; establishing a new connection between top port 2 
of R(2,3) and bottom port 1 of R(l,3) as shown in Fig. 6Q; starting top port 2 of R(2,3) and 
*P bottom port 1 of R(l,3); and stop diverting the traffic from top port 2 of R(2,3) and bottom port 1 
2fk ofR(l,3). 
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The process continues by selecting bottom port 2 of R(l,2) because scanning from right to left, it 
is the first port bottom or top not connected to anything and whose corresponding port 
(according to Fig. 3B) is also not connected to anything; establishing a new connection between 
25 bottom port 2 of R(l,2) and top port 2 of R(2,0) as shown in Fig. 6R; starting bottom port 2 of 
R(l,2) and top port 2 of R(2,0); and stop diverting the traffic from bottom port 2 of R(l,2) and 
topport2ofR(2,0). 



Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
30 connected. Again, scanning from right to left, top port 1 of R(2,4) is not connected to anything 
with corresponding port according to Fig. 3B, bottom port 1 of R(l,2). Bottom port 1 of R(l,2) is 
currently connected to top port 1 of R(2,2). The breaking this connection introduces a second 



23 



broken connection to R(2,2), so top port 1 of R(2,4) is not selected. Continuing to scan from 
right to left, top port 2 of R(2,2) is not connected to anything with corresponding port according 
to Fig. 3B, bottom port 0 of R(l,3). Bottom port 0 of R(l,3) is currently connected to top port 1 
of R(2,l). The breaking of this connection does not leave router R(l,3) or router R(2,l) with 
5 more than one broken connection. This completes the selection process for this step. 



With top port 2 of R(2,2) selected and recalling that its corresponding port, bottom port 0 of 
R(l,3), is connected to top port 1 of R(2,l), the process continues by diverting traffic from 
bottom port 0 of R(l,3) and top port 1 of R(2,l); stopping bottom port 0 of R(l,3) and top port 1 
10 of R(2,l); disconnecting bottom port 0 of R(l,3) and top port 1 of R(2,l) and moving the 
disconnected connection to top port 2 of R(2,2) as shown in Fig. 6S; starting top port 2 of R(2,2) 
and bottom port 0 of R(l,3); and stop diverting the traffic from top port 2 of R(2,2) and bottom 
port0ofR(l,3). 

o 

ig Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
■O connected. Again, scanning from right to left, top port 1 of R(2,4) is not connected to anything 
f| with corresponding port according to Fig. 3B, bottom port 1 of R(l,2). Bottom port 1 of R(l,2) is 
L currently connected to top port 1 of R(2,2). The breaking of this connection does not leave router 
~P R(l,2) or router R(2,2) with more than one broken connection. This completes the selection 

2jfe. process for this step. 

i 

With top port 1 of R(2,4) selected and recalling that its corresponding port, bottom port 1 of 
R(l,2), is connected to top port 1 of R(2,2), the process continues by diverting traffic from 
bottom port 1 of R(l,2) and top port 1 of R(2,2); stopping bottom port 1 of R(l,2) and top port 1 
25 of R(2,2); disconnecting bottom port 1 of R(l,2) and top port 1 of R(2,2) and moving the 
disconnected connection to top port 1 of R(2,4) as shown in Fig. 6T; starting top port 1 of R(2,4) 
and bottom port 1 of R(l,2); and stop diverting the traffic from top port 1 of R(2,4) and bottom 
port 1 of R(l,2). 
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The process continues by selecting top port 1 of R(2,2) because scanning from right to left, it is 
the first port bottom or top not connected to anything and whose corresponding port (according 
to Rg. 3B) is also not connected to anything; establishing a new connection between top port 1 
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of R(2,2) and bottom port 3 of R(l,l) as shown in Kg. 6U; starting top port 1 of R(2,2) and 
bottom port 3 of R(l,l); and stop diverting the traffic from top port 1 of R(2,2) and bottom port 3 
ofR(l,l). 

5 Scanning from right to left, no port, top or bottom, has a corresponding port which is not 
connected. Again, scanning from right to left, top port 1 of R(2,l) is not connected to anything 
with corresponding port according to Kg. 3B, bottom port 2 of R(l,l). Bottom port 2 of R(l,l) is 
currently connected to top port 0 of R(2,3). The breaking of this connection does not leave router 
R(l,l) or router R(2,3) with more than one broken connection. This completes the selection 

10 process for this step. 

With top port 1 of R(2,l) selected and recalling that its corresponding port, bottom port 2 of 
tj R(l,l), is connected to top port 0 of R(2,3), the process continues by diverting traffic from 
0 bottom port 2 of R(l,l) and top port 0 of R(2,3); stopping bottom port 2 of R(l,l) and top port 0 
Igj of R(2,3); disconnecting bottom port 2 of R(l,l) and top port 0 of R(2,3) and moving the 
8 disconnected connection to top port 1 of R(2,l) as shown in Kg. 6V; starting top port 1 of R(2,l) 
(Jl and bottom port 2 of R(l,l); and stop diverting the traffic from top port 1 of R(2,l) and bottom 
n port 2 of R(l,l). 

j» The process continues by selecting top port 0 of R(2,3) because scanning from right to left, it is 
-jjjj the first port bottom or top not connected to anything and whose corresponding port (according 
to Fig. 3B) is also not connected to anything; establishing a new connection between top port 0 
of R(2,3) and bottom port 3 of R(1,0) as shown in Kg. 6W; starting top port 0 of R(2,3) and 
bottom port 3 of R(1,0); and stop diverting the traffic from top port 0 of R(2,3) and bottom port 3 
25 ofR(l,0). 

This conq>letes the relabel and rewire phase applied to interconnection network 11 of Fig. 3A. In 
a conq>lete upgrade, this algorithm could then be applied to interconnection network 10 of Fig. 
3A, and finally interconnection network 12 of Fig. 3B in accordance with the first c ^ow_select" 
30 algorithm of Fig. 8. After all the interconnection networks are completed, the upgrade is finished 
by connecting and activating external connections 13 and 14. 
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The process depicted in application may be used also to reduce the fanout of routers in a 
network Simply reverse the process shown here. In summary, the process would involve 
disconnecting external connections to ports to be removed; rewiring each interconnection 
network in the same manner as those described above; and finally removing the unwired ports. 

5 

Though this invention is applied to a RBCCG network composed of rows of routers of consistent 
number per row and fanout per router. It may be applied to fault tolerant networks composed of 
rows of routers of varying number per row and fanout per router where the rows are connected 
with interconnection networks of the same type as that used in a RBCCG network. It also applies 
10 to any multistage network which can be expanded by fanout since the action of adding ports 
induces fault tolerance. In addition, it is not restricted to routers and may be applied to networks 
composed of other types of switching elements. 

J* 
O 

o 

V I. 

lp? Although the present invention has been described above in terms of specific embodiments, it is 

3 anticipated that alteration and modifications thereof will no doubt become apparent to those 

m skilled in the art. It is therefore intended that the following claims be interpreted as covering all 

JU such alterations and modifications as felling within the true spirit and scope of the invention. 



